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MAXIMUM ENTROPY METHOD FOR 
RECONSTRUCTION OF THE CMB IMAGES 
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We propose a new approach for the accurate reconstruction of cosmic microwave background distributions from 
observations containing in addition to the primary fluctuations the radiation from unresolved extragalactic point 
sources and pixel noise. The approach uses some effective realizations of the well-known maximum entropy method 
and principally takes into account a priori information about finiteness and spherical symmetry of the power spectrum 
of the CMB satisfying the Gaussian statistics. 
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1. Introduction 

Future cosmic microwave background (CMB) exper- 
iments, such as the PLANCK mission, are intended 
to produce the hi-precision determination of the cos- 
mological parameters. Therefore it is necessary to en- 
sure the adequate accuracy of removing the foreground 
contamination from the galactic dust, free- free and 
synchrotron emission, kinetic and thermal SZ effects 
from the galaxy clusters, extragalactic point sources 
(PS) and pixel noise. All the foregrounds can be di- 
vided in two main classes. The first one includes the 
so called low-multipole foregrounds (from galaxy and 
galaxy clusters) which give significant contribution to 
the total CMB observed signal in low spatial frequen- 
cies. The second one represents the hi-multipole fore- 
grounds from unresolved point sources and pixel noise. 
In this paper we stress attention on the problem of sep- 
aration of the hi-multipole foregrounds. The problem 
of extraction of point sources is considered by many au- 
thors. Tegmark et al||, have proposed to use optimal 
hi-pass filtering to suppress fluctuations due to CMB 
and to strengthen the point sources with subsequent 
discarding from the input CMB map the pixels con- 
taminated by the detected point sources within a beam 
size. This method is based on the idea that beginning 
from some value of multipole Id (damping scale of the 
CMB fluctuations) the CMB signal is strongly domi- 
nated by the point sources. The spectrum components 
between Id and and If (If is a cut-off frequency de- 
termined by the antenna filtering function), are consid- 
ered as initial data for a chosen method of separation 
of the point sources. In this paper we exploit the same 
idea and propose for selection of the PS foreground to 
use the maximum entropy method (MEM) as a very 
powerful technique for the image reconstruction from 
incomplete and noisy spectrum data. 

The whole separation algorithm consists of the fol- 
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lowing four steps: 

-deconvolution of the detected CMB map by the 
antenna beam profile to obtain a (CMB+PS) estima- 
tion; 

-MEM reconstruction of the PS foreground using 
those Fourier data of the (CMB+PS) estimated map 
which are located in (Id, If) multipole region; 

-discarding from the estimated (CMB+PS) map 
those pixels which are contaminated by detected PS 
and obtaining that a CMB estimation with the missing 
components ('holes'); 

-MEM reconstruction of the missing CMB com- 
ponents using a priori information about the finite- 
ness and spherical symmetry of the CMB power spec- 
trum. (Note that the finiteness of the spectrum in- 
dicates the analyticity property of CMB fluctuations. 
Therefore, in principle, the whole CMB signal can be 
reconstructed from only a known part.) 

It is expected, that the proposed approach is much 
more accurate than that described one in Tegmark et 
al||, because it allows to 1) detect the point sources 
with much smaller amplitudes, and 2) reconstruct the 
discarded CMB components. It necessary to note also 
that the reconstruction of the CMB distribution in 
'holes' allows to reconstruct the Gaussian nature of 
the primary CMB fluctuations. 

2. The maximum entropy method 

In our simulations we use the MEM technique for 
the realization of three main operations: 1) decon- 
volution of the input CMB map by antenna beam 
profile, 2) reconstruction of the PS foreground using 
the hi-multipole spectrum components, 3) reconstruc- 
tion of the discarded CMB components. For solving 
the second task we use a well-known standard max- 
imum entropy method suitable for reconstruction of 
only positive-definite signals. But for solving the first 
and third tasks a more general version of the MEM 
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(GMEM) (Bajkova|Q) is needed. This version enables 
to reconstruct the signals taking both positive and neg- 
ative values. First we consider the standard MEM ap- 
proach. 

2.1. The standard maximum entropy method 

Let x m i,m,l = 0, ...,M — 1 be unknown two - di- 
mensional signal determined in MxM discrete space. 
Then the maximum entropy solution for x m i satisfies 

- / J/ , x mi In Xml = H(x) = max, x m i > (1) 

m / 

subject to constraints on x m l provided by data. 

In all our tasks we deal with the linear constraints 
derived from the Fourier-space data which may be rep- 
resented as follows 

£ E x ™t cos(27r(nm + kl)/M) + rf nk = D r nk , (2) 
m I 

E J2 Xml MM*™ + kl )/ M ) + Vnk = Kk, (3) 



where D r nk ,D % nk , < n,k < M—l are data with super- 
scripts r and i denoting the real and imaginary parts 
respectively, r\ r nk and rf nk are the real and imaginary 
parts of the additive noise in data. 

It is important to built a noise-rejection mechanism 
into restoring algorithm. This results in further regu- 
larizing the outputs over and above what maximizing 
entropy can do. Assume the presence of the additive 
circular Gaussian noise. Let a^ k be the noise vari- 
ances for each of the real and imaginary parts at the 
spatial frequencies with coordinates (n, k) . Then the 
net estimation principle becomes 



H(x) - 1/2 E $>«fc + = max 



(4) 



This is equivalent to the search for a solution 
(x,rf ,rf) that maximizes the joint probability of un- 
known signal x m i and noise values rf nk and rf nk . By 
Bayes' theorem with a priori probability law for x 
given by exp[H(x)] this is also a maximum a poste- 
riori probability estimate of the unknowns. 

2.2. The generalized maximum entropy 
method for estimation of 
negative/positive signals 

Formulation (1) of maximum entropy can be applied 
exclusively to positive-definite real signals. However 
we want to work with the Shannon entropy of the real 
CMB fluctuations taking both positive and negative 
values. Such a real bipolar signal x m i can be repre- 
sented as the difference between two positive-definite 
functions (BajkovaB): 



> 0. 



(5) 



Signals x ml and x ml do not have the overlapping 
support regions. Let us replace the problem of estima- 
tion of x m i by that of estimation of xt^ and x~ ; : 

~ X H^ml lnX ™l + X ml lnX m l) = H ( x )- ( 6 ) 
m / 

The nonoverlapping support requirement for x ml 
and x ml would not necessarily be met simply by max- 
imizing (6). As shown in Bajkova[[l], a tuning parame- 
ter, a , must be inserted to form the associated entropy 

H(x, a) = 

" EX^mi m ( a2; mi) + X ml H^ ml )). (7) 

The value of a is at the discretion of the user. The 
action of a is to force nonoverlap as a is made larger. 

3. Model of the CMB detected map 

For simplicity only the small-angle patch of the sky is 
considered. Then the CMB fluctuations AT = T— < 
T > may be generated by evaluating the simple Fourier 
series (Bond et alQ ) : 

AT(6 x ,9 y ) 



T 



= E E D ( n u,n v )eyip[i — {n u x +n v 9 y )], (8) 

n„=0 n„=0 



where L denotes the size of the simulated region; 
(8x,9y) are Cartesian coordinates on the sky (spa- 
tial domain); (n Ul n v ) are coordinates of Fourier com- 
ponents D in spatial frequency domain. For Gaus- 
sian CMB fields the amplitude of D(n u , n v ) satisfies a 
Gaussian distribution with zero mean and variance 



2tt 



< I^K,^)! 2 >=C(0, l=—yjnl + n% (9) 

and phases at random in the interval (0, 27r) , where 
C(l) is the power spectrum associated with a spherical 
harmonic expansion of the radiation temperature, / is 
the multipole number (Bond et al[||). The PS back- 
ground is considered as a point-set of 8— functions ran- 
domly distributed over the sky patch. In our model the 
CMB detected (input) map can be represented as 



CMB det = (CMB + PS) 



N, 



(10) 



where * denotes the operation of convolution, W is a 
beam profile, N is a pixel noise. 
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Figure 1: Simulated maps: initial CMB (a); PS (b); initial noise N fc); CMB + PS (d); (CMB + PS) * W + N (el: 
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4. The CMB component separation 
algorithm 

First let us consider the noise-free case when 

CMB det = (CMB + PS) * W. 

For separation of the primary CMB and PS fore- 
ground we propose the following algorithm. 

1. Dcconvolution of the CMB input map by the 
antenna beam profile to obtain the estimation of the 
CMB+PS map being denoted as (CMB + PS) rec : 

(CMB + PS) rec = CMB det * W~ x . 

In doing it we maximize the generalized entropy 
functional in accordance with (7) because the sought 
for solution for (CMB + PS) rec can take both posi- 
tive and negative values. As input data we use all the 
Fourier components of the detected CMB input map. 
The linear constraints (2) and (3) in this case should 
be rewritten as 

E Xml cos(27r(nm + kl)/M)w nk + iff nk = D r nk , 

m I 

J2 E Xml sin ( 2 ^(«™ + kl)/M)w nk + rf nk = D* nk , 

m I 

where w nk ,n,k = 0, ...,M — 1 is the antenna beam 
function in Fourier domain; x rn i must be represented 
as (5). 

2. Reconstruction of the PS foreground using 
the standard MEM functional (4) determined for the 
positive-definite signals, from only those Fourier spec- 
trum components of the input CMB map, which are 
located in hi-multipole region (Id, I /) • 

Because the data used for the reconstruction of the 
PS foreground contain a noise due to the presence in 
them of the primary CMB signal, we expect that the 
PS distribution is reconstructed with perceptible er- 
rors. Therefore the direct subtraction of the recon- 
structed PS foreground from the (CMB + PS) rec map 
can provoke more perceptible errors in CMB estima- 
tion, than the simple discarding from the (CMB + 
PS) rec map the pixels, contaminated by PS (as pro- 
posed by Tegmark et al||). Therefore to increase the 
precision of the primary CMB reconstruction we pro- 
pose the implementation of the following two steps. 

3. Discarding from the (CMB + PS) rec map the 
pixels with coordinates of those PS reconstructed in 
the previous step, which amplitude is greater than 
some value of the threshold. This operation produces 
the estimation of primary CMB with missing compo- 
nents. The threshold value may be chosen to be com- 
paratively small in order to ensure the discarding from 



the CMB map as many as possible number of the con- 
taminated pixels. But this number should not be too 
large in order to ensure the acceptable MEM recon- 
struction in the next step of the algorithm. 

4. Reconstruction of the missing CMB components 
using a modified GMEM technique which principally 
takes into account a priori information about the most 
general features of CMB signal such as finiteness and 
spherical symmetry of its power spectrum. (Note that 
finiteness in spectrum domain means analyticity of sig- 
nal in space domain.) 

In the case of pixel-noise data the CMB detected 
map satisfies to equation (10). To take into account the 
pixel noise we propose to introduce new unknowns for 
the Gaussian pixel noise to include additional terms 
into the entropic functional and data constraints in 
parallel with the unknown signal. Then the entropic 
functional to be maximized, represented in the most 
general form considering that both signal and noise 
are bipolar, looks like : 

H(x, a) = -J2Y. x ™i Haxtni) + x m i H ax ml)~ 

m I 

- E E ^ HaN+ d ) + N ml ln(aN ml ) = max(ll) 

m I 

and the constraints provided by the data are as follows: 

EE^-o^"^ 

m I 

+ E Y,( N ™i - N m i)<a = Kk, (12) 

m I 

m I 

+E E(^-«c1 = ^- as) 

m I 

It is the only difference from the separation algo- 
rithm described in the previous subsection. 

5. Simulation results 

To test our approach we have simulated a large num- 
ber of experiments for both noiseless and noisy CMB 
observational data including the PS foregrounds of dif- 
ferent kind. All the tests for noiseless data have given 
approximately exact solutions for the CMB separa- 
tion. The experiment demonstrated here has been 
aimed to separate the primary CMB and PS compo- 
nents in presence of significant pixel noise. For genera- 
tion of the 7.5 degree square realization of the primary 
CMB fluctuations we used the CMB power spectrum 
function satisfying the ACDM model with parameters 
(n b h 2 = 0.02, n A = 0.65, n m = 0.3, ft = 0.65,n = 1). 
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Figure 2: Power angular spectra of: initial CMB map 
(solid), initial PS map (thin dotted); pixel noise map 
(dashed); CMB reconstructed map 2) (bold dotted); corre- 
sponding residual map (dash-dotted) 



The CMB map has been numerically generated as the 
Gaussian field in accordance with equations (8) and 
(9) mentioned in section 3. The size of discrete maps 
has been chosen as 64x64 pixels, so that the spatial 
spectrum of the CMB map is extended up to I = 1536 . 
The PS generation, reflecting the most usual case, con- 
sists of a number comparatively bright point-sources 
randomly distributed over the chosen sky patch. The 
pixel-noise map has been generated as the Gaussian 
field with zero mean and variance approximately equal 
to variance of the primary CMB. Antenna beam pro- 
file W has been constructed as the circular symmetric 
Gaussian function with a FWHM of 3 pixels. 

To realize the deconvolution operation we used the 
GMEM modification outlined in section 4. Simula- 
tion results are exposed in Figure 1, where (a) is the 
true primary CMB generation, (b) is the true PS fore- 
ground, (c) is the generation of the additive Gaus- 
sian pixel noise, (d) is the true CMB+PS map, (e) 
is the CMBdet map satisfying the equation (10), (f) is 
(CMB + PS) rec map obtained by use of the modified 
GMEM in accordance with equations (11), (12), (13), 
(g) is the distribution of the discarded contaminated 
pixels, determined by a chosen threshold value, (h) is 
the CMB rec map obtained by the GMEM interpo- 
lation algorithm using a priori CMB power spectrum 
information, (i) is the reconstructed PS foreground ob- 
tained by subtraction from the (CMB + PS) rec map 
of the CMB rec map. The corresponding power angu- 
lar spectra are shown in Figure 2. The variances of all 
the generated, reconstructed and residuals maps are 
listed in Table 1 . 



Tabic 1: Signals and their variances 



Map 


Variance 


CMB initial 


390.156 


PS initial 


1692.944 


Pixel Noise 


345.970 


CMB rec 


366.420 


Residuals 




CMB - CMB rec 


19.330 



6. Conclusions 

To summarize our results, we have proposed and suc- 
cessfully tested some effective realizations of the max- 
imum entropy method (including a generalized ver- 
sion for the distributions with both positive and nega- 
tive values) for the separation from the detected CMB 
maps of the hi-multipole foregrounds from extragalac- 
tic point sources even in presence of significant pixel 
noise. The whole foreground separation algorithm con- 
sists of four steps. The first one assumes the opera- 
tion of deconvolution of the detected CMB map by the 
antenna beam profile. In the second step we recon- 
struct the PS foreground by the standard MEM using 
as initial data the hi-multipole spectrum region of the 
CMB+PS recovered map. In the third step we discard 
from the CMB+PS map the pixels contaminated by 
the reconstructed PS, and in the last step we recon- 
struct the CMB discarded components by the GMEM 
procedure using a priori information about finitencss 
and spherical symmetry of the CMB power spectrum 
satisfying the Gaussian statistics. 
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